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(54) [Title of the Invention] 

RESOLUTION CONVERTER FOR IMAGE AND RESOLUTION 
CONVERSING METHOD FOR IMAGE 
(57) [Abstract] 
[Problem to be Solved] 

Zooming up and down of an image by a rational 
number can be implemented with a high image quality in 
a short processing time. 
[Solution] 

An input image 100 is up-sampled by a factor of U 
at an up-sampler 1 and sent to a digital filter 2. At 
the digital filter 2, filter computation is performed, 
where a filter feature for preventing U-fold up- 
sampling and the latter stage 1/D-fold down-sampling 
from causing distortion is provided and redundancy is 
eliminated. An output 102 from the digital filter 2 is 
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sent to a down-sampler 3 and down-sampled by a factor 
of D. 
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[Claims for the Patent] 
[Claim 1] 

An apparatus for converting resolution of an image 
characterized by comprising: 

up-sampling means for up-sampling an input image 
by a factor of U (U is an integer number) ; 

filtering means for filtering the up-sampled 
image; and 

down-sampling means for down-sampling the filtered 
image by a factor of D (D is an integer number) , 

wherein resolution is converted by a factor of U/D 
for the input image. 
[Claim 2] 

The apparatus for converting resolution of an 
image according to claim 1, characterized in that said 
filtering means have a transfer function decided 
according to scaling factor of up-sampling U and 
scaling factor of down-sampling D. 
[Claim 3] 

The apparatus for converting resolution of an 
image according to claim 1, characterized in that said 
filtering means have a feature of a composed transfer 
function H UD (z) that is obtained from the combination 
of the transfer function Hu(z) for a filter for 
preventing imaging in up-sampling and the transfer 
function H D (z) for a filter for preventing aliasing in 
down- sampling. 
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[Claim 4] 

The apparatus for converting resolution of an 
image according to claim 1, characterized in that, if a 
value of scaling factor of up-sampling U is bigger than 
a value of scaling factor of down-sampling D, said 
filtering means comprises zero order hold means and 
down-sampling means. 
[Claim 5] 

The apparatus for converting resolution of an 
image according to claim 1, characterized in that, if a 
value of scaling factor of down-sampling D is bigger 
than a value of scaling factor of up-sampling U, said 
filtering means comprises zero order hold means and 
average operation means-. 
[Claim 6] 

A method for converting resolution of an image 
characterized by comprising: 

an up-sampling step of up-sampling an input image 
by a factor of U (U is an integer number) ; 

a filtering step of filtering the up-sampled 
image ; and 

a down-sampling step of down-sampling the filtered 
image by a factor of' D (D is an integer number) , 

wherein resolution is converted by a factor of U/D 
for the input image. 
[Claim 7] 
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The method for converting resolution of an image 
according to claim 6, . characterized in that said 
filtering step have a transfer function decided 
according to scaling factor of up-sampling U and 
scaling factor of down-sampling D. 
[Claim 8] 

The method for converting resolution of an image 
according to claim 6, characterized in that said 
filtering step have a feature of a composed transfer 
function H UD (z) that is obtained from the combination 
of the transfer function Hu<z) for a filter for 
preventing imaging in up-sampling and the transfer 
function H D (z) for a filter for preventing aliasing in 
down-sampling. 
[Claim 9] 

The method for converting resolution of an image 
according to claim 6, characterized in that, if a value 
of scaling factor of up-sampling U is bigger than a 
value of scaling factor of down-sampling D, said 
filtering step is performed by using zero order hold 
and down- samp ling. 
[Claim 10] 

The method for converting resolution of an image 
according to claim 6, characterized in that, if a value 
of scaling factor of down-sampling D is bigger than a 
value of scaling factor of up-sampling U, said 
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filtering step, is performed by using zero order hold 
and average operation. 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

The present invention relates to an apparatus and 
a method for converting resolution of an image so as to 
zoom up and down the image by a factor of a rational 
number . 

[0002] 

[Conventional Art] 

When a function of zooming a thumbnail image or a 
digital image which is frequently used in an electronic 
still camera, a printer or the like is to be 
implemented, resolution converting of an image is 
required. 
[0003] 

With a conventional art, an image can be simply 
zoomed up or down by a factor of an integer number with 
a relatively simple manner. Resolution converting by a 
factor of a rational number, however, often requires 
complicated processing. 
[0004] 

[Problems to be Solved by the Invention] 

In the case where an image is simply zoomed up and 
down by a factor of an integer number with a 
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conventional art as mentioned above, as the resolution 
of the original image increases, a difference between 
sizes resulted from the division by the functions of 
integer numbers (for example, the difference between 
1/2 and 1/3) increases. That decreases smoothness in 
the zooming down. The same applies to the zooming up. 
[0005] 

Even if resolution can be converted by a factor of 
an integer number with a conventional art, some 
functions may result in remarkable distortion or 
require too much processing time, depending on the 
scaling factor. 
[0006] 

The present invention is adapted in view of the 
abovementioned problems and intends to provide an 
apparatus and a method for converting resolution of an 
image so as to implement zooming up and down by a 
factor of a rational number with high image quality in 
a simple manner, i.e., in a short processing time. 
[0007] 

[Means for Solving the Problems] 

In order to solve the abovementioned problems, the 
apparatus and the method for converting resolution of 
an image according to the present invention is 
characterized by converting resolution of an input 
image accompanied by zooming up and down by a factor of 
U/D by up-sampling the input image by a factor of U (U 
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is an integer number) , filtering the up-sampled input 
image, and down-sampling the filtered image by a factor 
of D (D is an integer number) . 
[0008] 

Digital filter means for converting a transfer 
function according to the resolution converting 
function so as to prevent distortion is used in the 
abovementioned filtering. The transfer function for 
the digital filter means preferably depends on the 
function U for up-sampling and the function D for down- 
sampling. More specifically, the transfer function is 
preferably a composed transfer function H UD (z) 
(=Hu(z) H D <z) ) that is obtained from the combination of 
the transfer function H 0 (z) for a filter for preventing 
imaging in up-sampling and the transfer function H D (z) 
for a filter for preventing aliasing in down-sampling. 
[0009] 

If the value of the function U for the up-sampling 
is bigger than the value of the function D for the 
down- samp ling, the zero-order hold or the down-sampling 
is preferably applied to the filtering. If the value 
of the function D for the down-sampling is bigger than 
the value of the function U for the up-sampling, the 
zero-order hold or the average operation is preferably 
applied to the filtering. 
[0010] 
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Up-sampling in the resolution conversion by a 
factor of a rational number has an effect of increasing 
the resolution of an image by using the zero-order hold 
means, for example. Down-sampling has an effect of 
calculating the resolution of an image by using the 
thinning processing or calculating an average for 
pixels, for example. The digital filter means has an 
effect of performing convolution by setting a transfer 
function according to each value of the zooming up 
function U and the zooming down function 1/D and 
multiplying a pixel unit by a filter factor. 
[0011] 

The digital filer means has an effect of 
regulating a bandwidth so as to prevent up-sampling or 
down-sampling from causing imaging or aliasing. 
[0012] 

[Embodiments of the Invention] 

Embodiments of the apparatus and the method for 
converting resolution of an image according to the 
present invention will be described with reference to 
the drawings. 
[0013] 

A first embodiment of the apparatus for converting 
resolution of an image according to the present 
invention is shown in Figure 1. The apparatus for 
converting resolution of an image as the first 
embodiment of the present invention shown in Figure 1 
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includes a U-fold up-sampler 1 that up-samples an input 
image 100 by a factor of U (U is an integer number) , a 
digital filter 2 that filters an image 101 that is up- 
sampled, and a 1/D-fold down-sampler 3 that down- 
samples a filtered image 102 by a factor of D (D is an 
integer number) . With the configuration shown in 
Figure 1, resolution of the input image 100 is 
converted by a factor of U/D and the resulted image is 
extracted as an output image 103. 
[0014] 

The transfer function of the digital filter 2 
preferably depends on the function U for up-sampling 
and the function D for down-sampling. In the case 
where the transfer function for a filter that removes 
an imaging component is H 0 (z) and the transfer 
function for an anti-aliasing filter that removes 
loopback distortion is H D (z) , in which the imaging 
component is a spectrum component that is newly 
generated by a factor of U-fold up-sampling and the 
loopback distortion is caused by 1/D-fold down-sampling, 
the transfer function for the digital filter 2 H UD (z) 
is preferably 
Hod (z) = Hu (z) H D (z) 

so as to be a function without redundancy. 
[0015] 

If the value of U is bigger than the value of D, a 
zero-order hold circuit and a down-sample circuit are 
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preferably used for the digital filter 2. If the value 
of D is bigger than the value of U, a zero-order hold 
circuit and an average operation circuit are preferably 
used for the digital filter 2. 
[0016] 

Four methods which provide basic techniques used 
in each embodiment of the present invention will be 
described. Specifically, the four methods are the 
zero-order hold for zooming up an image, the linear 
interpolation, the down-sample for zooming down an 
image, and the average operation. 
[0017] 

As the first method, the zero-order hold is. known 
as the simplest method. When the zero-order hold is 
applied to a one-dimensional pixel column, zooming up 
by a factor of N corresponds to interpolating N-l 
pixels of the same value near the object pixel. The 
zero-order hold has a problem in that a high 
enlargement ratio results in an image quality with 
discontinuous blocks in spite of its simple processing. 
[0018] 

Figure 2 shows an example of the zero-order hold 
for zooming up an image by a factor of three. Figure 2 
(A) shows a part of an original image, for example 
3 (height) x 3 (width) pixels. In the case of zooming up 
by a factor of three (zooming up by a factor of nine in 
the area ratio), 3 (height) x 3 (width) pixels of the 
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same value are arranged for a pixel and a part 
corresponding to the 3x3 part of the original image 
is formed by 9 x 9 pixels as shown in Figure 2 (B) . A 
row L of the part of 9 x 9 pixels in the zoomed up 
image is extracted and described with pixel values in 
the vertical axis in Figure 2 (C) . Each circle drawn 
by dashed line in Figure 2 (C) is a pixel that is 
interpolated by the zero-order hold. Two pixels Ps of 
the same value are interpolated next to each pixel in 
the original image (a circle drawn by solid line in the 
figure) . 
[0019] 

The second method, the linear interpolation, which 
is also called as the bilinear interpolation, can 
generate a relatively smooth zoomed up image. This 
method generates a pixel that is interpolated as the 
image is zoomed up by linear approximation between 
adjacent pixels in the original image. 
[0020] 

Figure 3 shows a specific example of the linear 
interpolation for zooming up an image by a factor of 
three. Figure 3 (A) shows a part of an original image, 
for example 3 (height) x 3 (width) pixels. In the case 
of zooming up by a factor of three, interpolating 
pixels Ps are arranged between the pixels and a part of 
zoomed up image with 9 (height) x 9 (width) pixels is 
formed as shown in Figure 3 (B) . The interpolating 
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pixel P is obtained by the linear approximation between 
adjacent pixels in the original image as shown in 
Figure 3 (C) . Therefore, outside pixels Q are required 
to obtain interpolating pixels next to the rightmost or 
bottom pixels in the original image. If an image is to 
be zoomed up with the number of pixels exactly 
increased by a factor of an integer number, the linear 
approximation is performed with provisional pixels Qs 
added so that interpolating pixels on the edge are 
generated. The pixels to be added are generally 
selected so that they are symmetrical with respect to 
the pixels at the edge of the image (see Figure 3 (C) ) 
and removed after the liner interpolation in 
consideration of smoothness of the image. With the 
linear interpolation, a smooth zoomed up image can be 
obtained with somewhat less sharpness at the edge. 
[0021] 

The third method, the down-sample method, is known 
as the simplest method. When the down-sample is 
applied to a one-dimensional pixel column, zooming down 
by a factor of N with the down-sample corresponds to 
processing of selecting a pixel for each N pixels and 
rearranging the image. In spite of the simple 
processing, this method may cause loopback distortion 

(aliasing) if it is applied to an image including high- 
frequent components . 

[0022] 
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Figure 4 shows a specific example of the down- 
sample for zooming down an image by a factor of 3. A 
pixel is selected from each three pixels in a part of 
the original image with 9 (height) x 9 (width) pixels as 
shown in Figure 4 (A) and the other pixels Rs are 
thinned out. As a result, a part of a zoomed down 
image with 3 (height) x 3 (width) pixels as shown in 
Figure 4 (B) is formed. 
[0023] 

Now, the fourth method, the average operation will 
be described. When the method is applied to a one- 
dimensional pixel column, zooming down by a factor of N 
with the average operation is processing of calculating 
an average for each N pixels and rearranging the image 
by using the value as the pixel value of the zoomed 
down image. As the averaging corresponds to a low-path 
filter, the method can reduce occurrence of loopback 
distortion (aliasing) . 
[0024] 

Figure 5 shows a specific example of the average 
operation for zooming down an image by a factor of 3. 
Nine pixel values in each region of 3 (height) x 
3 (width) pixels in a part of the original image with 
9 (height) x 9 (width) pixels as shown in Figure 5 (A) 
are averaged and the averages are used as pixel values 
of a zoomed down image. As a result, a part of a 
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zoomed down image with 3 (height) x 3 (width) pixels as 

shown in Figure 5 (B) is formed. 

[0025] 

Now, before describing the method for converting 
resolution of an image by a factor of U/D, a method for 
zooming up an image by a factor of U and a method for 
zooming down an image by a factor of D will be 
described below. First, the method for zooming up an 
image by a factor of U will be described. 
[0026] 

Figure 6 (A) shows basic configuration for zooming 
up an image by a factor of U, including a U-fold up- 
sampler 6 and a digital filter 7 whose transfer 
function is Hu (z) . The transfer function Hu (z) of the 
digital filter is an expression on a z axis (z=exp 
(j©T) . An impulse response of a filter, which is an 
expression of the transfer function on a time axis, is 
provided as hu (n) . "n" is the number of samples 
(sample number, sample position) on the time axis. 
Similarly, an input image 104 is provided as x (n) , an 
output 107 from the up-sampler 6 is provided as c (n) , 
and an output 108 from the digital filter 7 is provided 
as y (n) . Now, the operation thereof will be described. 
[0027] 

The input image 104 is sent to the U-folded up- 
sampler 6, and the image is up- sampled by a factor of U. 
The up-sampling operation is specifically shown in 
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Figure 7. As shown in Figure 7, the U-fold up-sampling 
is the operation of inserting (U-l) zero values. 
[0028] 

That is, a part of the original image with 
3 (height) x 3 (width) pixels as shown in Figure 7 (A) is 
up-sampled by three by the three-fold up-sampler 6a as 
shown in Figure 7 (B) . As shown in Figure 7 (C) , two 
zero values are inserted between pixels in the one 
dimensional direction and eight zero values are 
inserted for each original pixel in the two dimension. 
Accordingly, the part of the original image with 
3 (height) x 3 (width) pixels is converted into the part 
with 9 (height) x 9 (width) pixels in the zoomed up image. 
[0029] 

The up-sampled image 107 that is generated in the 
manner is input into the digital filter 7 of the 
transfer function H 0 (z) and filtered. Then, the U-fold 
zoomed up image 108 is output. 
[0030] 

Now, a feature to be fulfilled by the digital 
filter 7 of the transfer function Hu (z) will be 
described. For ideal zooming up of an image by a 
factor of U, the low-path filter needs to be designed 
in consideration of variation in the frequency band for 
signals caused by up-sampling. Figure 8 (A) and (B) 
show the frequency band X (z) of the original signal 
and the frequency band X 0 (z) of the image up-sampled 
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by a factor of U, respectively. w co" is the normalized 
angle frequency. The dashed line shown in Figure 8 (B) 
is an imaging component (a spectrum component created 
anew by up-sampling) , which needs to be removed when a 
zoomed up image is to be obtained. Accordingly, an 
ideal low-path filter Hu (z) shown in Figure 9 (A) is 
used so that a zoomed up image with the frequency band 
Yo (z) shown in Figure 9 (B) can be obtained. As a 
result, a digital filter with a feature of the ideal 
low-path filter H D (z) as shown in Figure 9 (A) is 
selected for the digital filter 7 of the transfer 
function H 0 (z) shown in Figure 9 (B) . 
E0031] 

Now, the method for zooming down an image by a 
factor of D will be described. Figure 6 (B) shows 
basic configuration for zooming down an image by a 
factor of D, including a digital filter 4 whose 
transfer function is.H D (z) and a 1/D-fold down-sampler 
5. An impulse response of the digital filter 4 is 
provided as h H (n) as an expression on a time axis. The 
input image 104 is provided as x <n) , an output 105 
from the digital filter 4 is provided as p (n) , and an 
output 106 from the down-sampler 5 is provided as y (n) . 
Now, the operation thereof will be described. 
[0032] 

The input image 104 is first input into the 
digital filter 4 and the filter output 105 is output. 
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The filter output 105 is down-sampled by a factor of D 
at the down-sampler 5. The down-sampling by a factor 
of D is the operation of extracting (D-l) pixels. The 
image 106 zoomed down by a factor of D generated in the 
manner is output. 
[0033] 

Figure 10 specifically shows the down-sampling 
operation by taking an example of the case of D=4. In 
Figure 10, 1/4-fold down-sampler 5a as shown in Figure 
10 (B) extracts three pixels from each four pixels in 
the one dimensional direction and removes the pixels Rs 
leaving one pixel from 4x4 pixels in the two 
dimension for a part of the original image with 12 x 12 
pixels as shown in Figure 10 (A) . Then, an image is 
generated as a zoomed down image as shown in Figure 10 

(C) , i.e., a part of the image that is down-sampled by 
a factor of 4 with 3x3. 

[0034] 

Now, a feature to be fulfilled by the digital 
filter 4 of the transfer function H D (z) will be 
described. For ideal zooming down of an image by a 
factor of D, the original signals need to be limited 
for the band by the low-path filter H D (z) so that bands 
is prevented from overlapping each other {loopback 
distortion) on the frequency region caused by the down- 
sampling. Figure 11 (A) and (B) show the frequency 
band X (z) of the original signal and the frequency 
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feature of the low-path filter H D (z), respectively. 
The frequency band X L (z) that is limited for the band 
by H D (z) is such as shown in Figure 12 (A) . The 
frequency band Y D (z) that is the result of the down- 
sampling performed on the signals by a factor of D is 
such as shown in Figure 12 (B) . Accordingly, a zoomed 
down image without loopback distortion can be obtained. 
[0035] 

Conditions that the means and the filter need to 
fulfill in zooming up by a factor of U and zooming down 
by a factor of D have been described. 
[0036] 

Here, relationship between signals shown in Figure 
6 x (n) , c (n) , y (n) , p (n) will be described by 
formulae. Relations between the signals x (n) , p (n) , 
y (n) in the case of zooming down by a factor of D as 
shown in Figure 6 (B) are shown below. 
P (n) =2X (k) h D (n-k).... (1) 
y (n) - p (Dn) = 2x (k) h D (Dn-k) .... (2) 
Relations between x (n) , c (n) , y (n) in the case of 
zooming up by a factor of U as shown in Figure 6 (A) 
are shown below, 
y (n) = Sc (k) h D (n-k) .... (3) 

y (n) = Sc (Uk) h c (n-Uk) = £x (k) h 0 (n-Uk) .... (4) 
xx h D (n) " and "hu (n)" in the formulae denote impulse 
responses of filters 4 and 7. 
[0037] 
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Now, how the resolution conversion by a factor of 
U/D according to the embodiment of the present 
invention is implemented by using the basic techniques 
as mentioned above will be described. 
[0038] 

For the purpose of resolution conversion by a 
factor of U/D, only the configuration for zooming up an 
image by a factor of U as shown in Figure 6 (A) and the 
configuration for zooming down an image by a factor of 
D as shown in Figure 6{B) need to be connected as shown 
in Figure 13. It is easily understood that the 
connection results in the configuration shown in Figure 
13 (A) . Configuration eliminated of the redundancy of 
the configuration is shown at the bottom of the figure. 
It is apparent that H 0D (n) = H w (n) Hu (n) is 
established here. 
[0039] 

"d (n) , y (n)" in Figure 13 (B) are expressed as 
the formula (5) . The formula (2) is substituted in the 
formula (5), resulting in the formula (6). That is, 
the result is shown below. 

d (n) = 2x (k) h UD (n-Uk) (5) 

y (n) = Ex (k) h UD n(Dn-Uk) (6) 

Those are the expressions eliminated of redundancy. 
[0040] 
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Now, eliminating redundancy in the conversion of 
resolution will be described. For efficient conversion, 
it is important to eliminate redundancy. 
[0041] 

In the configuration shown in Figure 13 (A) , the 
component for zooming down an image by a factor of D 
corresponds to that shown in Figure 6 (B) . The 
processing performed by the digital filter 4 is 
represented as convolution of x (n) and p (n) as shown 
in the formula (1) . For example, in the case of D=2, 
as shown in Figure 14 (A) , the operation of performing 
convolution by cutting two pieces of data out may be 
shifted by one pixel and filter outputs p(0), p(D, 
p(2), p(3), ...may be obtained, and then a piece of data 
may be thinned out from the two pieces of data at the 
down-sampler 5 so that pieces of data p(0), p{2), a 
piece for each two pieces, are extracted as outputs 
y(0), Y(l), .... In contrast, the formula (2) maybe 
directly calculated so that the output y (n) is 
obtained. That is the processing of performing the 
convolution on the input data x (n) by shifting it by 
two pixels and eliminating redundancy, as shown in 
Figure 14 (B) . That is, in the case of D=2, the 
throughput in the case of Figure 14 (B) is required to 
be almost the half of the throughput in the case of 
Figure 14 (A) . That simplifies the processing and 
shortens the processing time. 
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[0042] 

In the configuration shown in Figure 13 (A) , the 
component for zooming up an image by a factor of U 
corresponds to that shown in Figure 6 (A) . The 
relationship between c (n) and y (n) is represented as 
convolution as shown in (3) . As non-zero values of c 
(n) appear for each U, it is useless to directly 
calculate them. When x (n) = c (Un) is focused, the 
relationship between x (n) and Y (n) is provided as the 
formula (4) . That is directly calculated and 
redundancy is eliminated. Figure 15 shows the case of 
U=2 as an example. One (=2-1) zero value is inserted 
between pieces of input data x (n) shown in Figure 15 
(A) by twice up-sampling, resulting in data c (n) shown 
in Figure 15 (B) . The data is shifted by two pixels as 
shown in Figure 15 (C) when the data is subjected to 
linear interpolation at the filter. That eliminates 
redundancy. 
[0043] 

As shown in Figure 13 (B) , filters of the transfer 
function of H 0 (n) and H D (n) are combined into a 
filter 8 of the transfer function H UD (n) (=H 0 (n) H D (n)), 
and the filter calculation is directly performed by the 
formula (5), and the formula (6) is also directly 
performed in consideration of down-sampling. That 
significantly eliminates redundancy. 
[0044] 
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It is apparent that the configuration shown in 
Figure 13 (B) is the same as that shown in Figure 1 as 
the basic configuration of the first embodiment of the 
present invention. An image is zoomed up or zoomed 
down according to the relationship of values of U and D. 
In the description of an embodiment below, specific 
examples for respective cases will be described. 
[0045] 

Now, a second embodiment of the present invention 
will be described. The second embodiment relates to an 
apparatus and a method for converting resolution of an 
image by a factor of a rational number. The 
configuration and operation of zooming up by a factor 
of U>D, i.e., a rational number will be described. 
[0046] 

When the case of zooming up by a factor of 3/2, in 
which U=3 and D=2, is taken as a specific example of 
zooming up, the filter features of H u {z) and H D (z) are 
shown as Figure 16 (A) and (B) . The processing 
performed by the two filters is apparently equivalent 
to processing performed by a single filter shown in 
Figure 16 (C) , which is the same as that shown in 
Figure 16 (A). Accordingly, the filter Hud U) that is 
used in zooming up by a factor of 07 D (U>D) may be the 
filter H u (z) in zooming up by a factor of U. 
[0047] 
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As mentioned above, the zero-order hold with up- 
sampling (see Figure 2) can be used for zooming up by a 
factor of U. The linear interpolation shown in Figure 
3 may be used for the purpose of keeping smoothness of 
the image quality. Relation between them will be 
expressed as below. 
[0048] 

zero-order hold: H 0 <z) = (l+z _1 +z" 2 + + z -1 *"" 1 ') 

= H zero (z) ...(7) 
linear interpolation: H 0 (z) = H zero U) H zero (z -1 ) /U 
= (l+z^+z-^ +z- (ul) ) 
x (l+z 1 +z 2 + +z u_1 )/U...(8) 
That is, the transfer function for the linear 
interpolation is expressed such as the transfer 
function of the zero-order hold is delayed in time and 
multiplied with the transfer function (H zer o(z) and H zero 
(z _1 ) ) . 1/D of U/D-fold may be simple down-sampling. 
[0049] 

Processing in the case of U>D has been described. 
[0050] 

Now, a third embodiment of the present invention 
will be described. As the third embodiment, the 
configuration and operation in the case of resolution 
conversion by a factor of a rational number, which is 
zooming down by a factor of U<D, i.e., a rational 
number will be described. 
[0051] 
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As a specific example of zooming down, zooming 
down by a factor of U/D = 2/3 is considered. As 
mentioned above, the filter features of Hu (z) and H D 

(z) are shown as Figure 17 (A) and (B) . Here, the 
processing performed by two filters is equivalent to 
processing performed by a single filter H DD (z) shown 
in Figure 17 (C) . As the relationship is H 0D (z) = 2H D 

<z), the filter H UD (z) that is used in zooming down by 
a factor of U/D (U<D) may be the filter U • H D (z) , 
which is the filter H D (z) for zooming down by a factor 
of D adjusted for the gain {multiplied by a factor of 
U). 

[0052] 

Zooming down by a factor of U/D may be implemented 
by the transfer function that is expressed as the 
product of the transfer function % (z) of the zero 
order hold in the formula (7) and the average operation 
means (see Figure 5) in the formula (9), where the 
transfer function H u (z) is used for zooming up by a 
factor of U and the average operation means is used for 
zooming down by a factor of D. That is, 

Hp (z) = (l+z^+z"^ +z" (u " 1) )/D ...(9) 

Hud (z) = H D (z) H D (z) 

[0053] 

Now, a fourth embodiment will be described. In 
the fourth embodiment, the apparatus for converting 
resolution is provided with high-frequencies-gain 
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emphasizing filter means at the front part so that the 
means operates in zooming up an image. That is, the 
fourth embodiment is for reducing a blur and the loss 
of sharpness of an image which is caused in zooming up 
by a rational number of U>D. 
[0054] 

Figure 18 shows an example of the configuration of 
the fourth embodiment, including a high-frequencies- 
gain emphasizing filter 9 that is connected with the 
front part of the apparatus for converting resolution 
of an image that is formed by a 0-fold up-sampler 1, a 
digital filter 2 and a 1/D-fold down-sampler 3. Now, 
the operation will be described. 
[0055] 

The high-frequencies-gain emphasizing filter 9 may 
be a (3 x 3) two dimensional filter as shown in Figure 
19. Filter coefficients f x to f 9 of the high- 
frequencies-gain filter as shown in Figure 19 may be 
decided as 
fs = 8, 

fi = f 2 - f 3 = f4 - U = f? - fe = U = -1- 
The high-frequencies-gain emphasizing filter 9 has an 
effect of emphasizing the high-frequency component of 
the input image. Although the high-frequencies-gain 
emphasizing filter 9 may be one with an N x N filter 
coefficient, a positive central part coefficient value 
and each of the other coefficients being -1, the high- 
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frequencies-gain emphasizing filter is not limited to 

that. 

[0056] 

A filtered image 111 that is obtained as the 
coefficients are multiplied with the pixels is input 
into the U-fold up-sampler 1 with the similar 
configuration as that of the first embodiment. The 
processing after the U-fold up-sampler 1 may be that 
described above. As an output 112 from the up-sampler 
1, an output 113 from the digital filter 2, and an 
output 114 from the 1/D-fold down-sampler 3 correspond 
to the outputs 101, 102, 103 shown in Figure 1, they 
are omitted from the description. 
[0057] 

As in the fourth embodiment, with the high- 
frequencies-gain emphasizing filter 9 provided at the 
front part, a blur and the loss of sharpness in an 
image which are caused in zooming up are reduced so 
that a zoomed up image with a high image quality can be 
obtained. 
[0058] 

As another embodiment, the N x N filter 
coefficient value multiplied with a certain parameter 
value may be made a new filter coefficient value and 
the parameter value may be made variable so that high- 
frequencies emphasizing image quality adjusting means 
is provided for the high-frequencies-gain emphasizing 
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filter 9. That is, a certain parameter value p may be 
multiplied with each of the filter coefficients fi to 
f 9 shown in Figure 19 and the result may be made a new 
filter coefficient value so that image adjustment such 
as edge emphasis is performed. 
[0059] 

The present invention can be applied to a case 
where a zooming function is implemented on a thumbnail 
image or a digital image which are frequently used in 
an electronic still camera, a printer or the like. As 
specific applications, an electronic camera, a personal 
digital assistant (PDA) , a printer, a satellite image, 
a medical image or a software module and the like for 
the same can be considered. 
[0060] 

[Advantages of the Invention] 

According to the present invention, an input image 
is up-sampled by a factor of U (U is an integer number) , 
the up-sampled image is filtered, and the filtered 
image is down-sampled by a factor of D (D is an integer 
number) so that resolution of the input image is 
converted accompanied by zooming up and down by a 
factor of a rational number, i.e., U/D. 
[0061] 

That enables easy implementation of resolution 
conversion by a rational number, where conventional 
arts can only implement mainly simple zooming up or 
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down on an image by a factor of an integer number. 
That enables a resolution converted image with high 
image quality to be always obtained without distortion 
whatever the values of U and D are. 
[0062] 

That has an advantage of eliminating redundancy 
and requiring a short processing time as digital filter 
means for converting a transfer function according to a 
resolution converting ratio so as to prevent distortion 
is used for filtering, and the transfer function of the 
digital filter means is decided by the scaling factor 
of up-sampling U and the scaling factor of down- 
sampling D, more specifically the transfer function is 
decided as a combined transfer function Hud (z) (= Hu 

(z) H D (z)) that is resulted from combining the 
transfer function Hu (z) for a filter that prevents 
imaging in up-sampling and the transfer function H D (z) 
for a filter that prevents aliasing in down-sampling. 

[0063] 

If the value of the scaling factor of up-sampling 
U is bigger than the value of the scaling factor of 
down-sampling D, the zero order hold and the down- 
sampling are used for the filtering. If the value of 
the scaling factor of down-sampling D is bigger than 
the value of the scaling factor of up-sampling U, the 
zero order hold and the average operation are used for 
the filtering. That enables the resolution conversion 



- 29 - 



JPA2000-165664 



by a rational number to be implemented with a high 
image quality kept by simple configuration in a short 
processing time. 

[Brief Description of the Drawings] 
[Figure 1] 

Figure 1 is a block diagram showing basic 
configuration of an apparatus for converting resolution 
that is for converting resolution of an image by a 
rational number as a first embodiment of the present 
invention; 
[Figure 2] 

Figure 2 is a diagram for illustrating a concept 
of a zero order hold; 
[Figure 3] 

Figure 3 is a diagram for illustrating a concept 
of linear interpolation; 
[Figure 4] 

Figure 4 is a diagram for illustrating a concept 
of down-sampling; 
[Figure 5] 

Figure 5 is a diagram for illustrating a concept 
of average interpolation; 
[Figure 6] 

Figure 6 is a block diagram showing basic 
configuration of each case of zooming up an image by a 
factor of U and zooming down an image by a factor of D; 
[Figure 7] 
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Figure 7 is a diagram for illustrating a concept 
of three-fold up-sampling; 
[Figure 8] 

Figure 8 is a diagram for illustrating a freguency 
band after the up-sampling; 
[Figure 9] 

Figure 9 is a diagram for illustrating a frequency 
band for an image zoomed up by a factor of U; 
[Figure 10] 

Figure 10 is a diagram for illustrating a concept 
of down-sampling by a factor of 4; 
[Figure 11] 

Figure 11 is a diagram for illustrating a 
frequency band for an ideal low-path filter that is 
used in zooming down an image by a factor of D; 
[Figure 12] 

Figure 12 is a diagram for illustrating a 
frequency band of an image zoomed down by a factor of 
D; 

[Figure 13] 

Figure 13 is a block diagram showing configuration 
for implementing resolution conversion by a factor of 
U/D as configuration for zooming up an image by a 
factor of U and zooming down an image by a factor of D 
combined; 
[Figure 14] 
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Figure 14 is a diagram for illustrating 
elimination of redundancy in the case of zooming down 
an image by a factor of 2; 
[Figure 15] 

Figure 15 is a diagram for illustrating 
elimination of redundancy in the case of zooming up an 
image by 2; 
[Figure 16] 

Figure 16 is a diagram for illustrating a filter 
feature in zooming up an image by a factor of 3/2; 
[Figure 17] 

Figure 17 is a diagram for illustrating a filter 
feature in zooming down an image by a factor of 3/2/ 
[Figure 18] 

Figure 18 is a block diagram showing an example of 
configuration of an apparatus for converting resolution 
of an image with a high-frequencies-gain emphasizing 
filter provided; and 
[Figure 19] 

Figure 19 is a diagram for illustrating a filter 
coefficient of the high-frequencies-gain emphasizing 
filter. 

[Description of Symbols] 

1, 6 U-fold up-sampler 

2, 4, 7, 8 digital filter 

3, 5 1/D-fold down-sampler 
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Figure 1 

1 U-FOLD UP-SAMPLER 

2 DIGITAL FILTER 

3 1/D-FOLD DOWN SAMPLER 

Figure 2 

#1 ORIGINAL IMAGE 

#2 ZOOMED UP IMAGE (BY THREE) 

Figure 3 

#1 ORIGINAL IMAGE 

#2 ZOOMED UP IMAGE (BY THREE) 

Figure 4 

#1 ORIGINAL IMAGE 
#2 ZOOMED DOWN IMAGE 

Figure 5 

#1 AVERAGING 

#2 ORIGINAL IMAGE 

#3 ZOOMED DOWN IMAGE 

Figure 7 

#1 ORIGINAL IMAGE 

#2 IMAGE UP-SAMPLED BY THREE 

#3 ORIGINAL PIXEL 

#4 ZERO VALUE 
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Figure 8 

#1 FREQUENCY BAND OF ORIGINAL SIGNAL 
#2 IMAGING COMPONENT 

#3 FREQUENCY BAND AFTER UP-SAMPLING 
Figure 9 

#1 IDEAL LOW-PATH FILTER USED IN ZOOMING UP BY U 
#2 FREQUENCY BAND OF IMAGE ZOOMED UP BY U 

Figure 10 

#1 IMAGE DOWN SAMPLED BY A FACTOR OF 4 
#2 ORIGINAL IMAGE 
#3 ORIGINAL PIXEL 
#4 EXTRACTED PIXEL 

Figure 11 

#1 FREQUENCY BAND OF ORIGINAL SIGNAL 

#2 IDEAL LOW-PATH FILTER USED IN ZOOMING DOWN BY A 

FACTOR OF D 

Figure 12 

#1 FREQUENCY BAND OF SIGNAL LIMITED FOR BAND 

#2 FREQUENCY BAND OF IMAGE ZOOMED DOWN BY A FACTOR OF 

D 

Figure 14 
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#1 FILTERING (CONVOLUTION) 
#2 THINNING OUT OF DATA 

Figure 15 

#1 INSERT ZERO VALUE 
#2 OBTAIN TOTAL SUM 

Figure 16 

#1 AMPLITUDE 

Figure 17 

#1 AMPLITUDE 

Figure 18 

1 U-FOLD UP-SAMPLER 

2 DIGITAL FILTER 

3 1/D-FOLD DOWN SAMPLER 

9 HIGH FREQUENCIES GAIN EMPHASIZING FILTER 
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